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Development of A Theory of Information Flow and Analysis* 

MX. Yovlta, L.L. Rose, j.c. Abllock 
The Ohio Sta'te University 

Columbus, Ohio v 



Abstract 



This paper describes research being carried out at The 
Ohio State University leading toward a general theory of in- 
formation now and analysis. The objectives of the National 

analysis- ^/r^^^ °' Information flow and 

iTlr V. identify Important parameters and variables 

sureS* " P'°"«« which can be quantified and mea- 

d^«^rlhp ? '«l^ti°"shlps among the variables which 

describe their behavior and limitations; (A) to apply this 

inZlinl ^P^^f^SPJ-^^-^-i situations. paitlcWa^y ^os:. 
UM^n ! information; and <5> to*^develop both s!mu- 

da Jon o? r''^'"""-^' "^^^'^ '''' quantification and vaU- 
aation or the theory. 

The generalized . od-1 of Information flow Is shown to 

we'dtrl^e I'^'^'f^'y .f' ,^^<^^-^-- situation. Using Jhls .ocJel 
we derive a nuirbe: of measures. Two of the more important 

ones arcj I = tn l 

_ z=J ' 

'■^ , 
Vl-E - I p(a,} EV 

i=l J - 

can quanUfy the .mount of Information (X) In a decision 
state and cv.ilu.itc- .leclslon-maker effectiveness f/VS; . We 
can also determine the value of infor-nation through Its 



?(aJ' 



1 and 



/max (FV with these measur 



es we 
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effec jn DME. Rules are derived for use by the decision- 
maker for asslmllat'lng new data In his estimates of values 
and for use In determining selection probabilities for var- 
ious courses of action. These rules enable feedback* learn- 
lng» and alternative selection to ^be^modeled, measured^ and 
evaluated* Research Is underway to validate »the model real- 
istically and to apply It to practical situations^ 

A further possible result of this research Is the devel- 
opment of a decision calculus which will establish guidelines 
for decision-making given certain situations* These guide- 
lines should permit quantification of tpe Importance of 
information in the decision-making proc)^ss* 

Background 

, In several previous papers (l^B^SJ^ we have discussed 
some of the properties which should exist If Information 
science Is ever to become a "true^' science similar to physics 
or chemistry. It has been polnte'd out that a number of ana* 
lytlcal expressions and concepts should exlstjwhlch can be 
used to describe and analy^ze Information flow» A framework^ 
called a "generalized Informatlori system" was suggested which 
permits the development of these concepts and expressions. 

The wor^ "information^' takes on a variety of meanings 
depending up6n the context In which It Is used* Our approach 
relates Information to its effectiveness and thUs its use and 
value* Information Is frequently used rather specifically in 
the sense of the Shannon and.V/eaver "infortnatlon theory" 
(more accurately called "communication theory"). In this 
sense the context of the message Is of no significance; the 
theory-is concerned with the probability of the^ receipt of 
any particular message for various conditions of the trans- 
mission system* While this may be of Interesst in Information 
science, it is certainly -not^the major nor even a large part 
of Information science. Such a treatment does Hot consldjer 
the vital areas of concern, almost all of which are Involved 
with' the context, meaning^ and effectiveness of the message. 
For these reasons, the Shannon and Weaver approach is gener* 
ally regarde*d as too restrictive to be £i basis for the. formu- 
lation of an Information science. At ^he other extreme, the 
trf>atment of information to be synonymous with knowledge 
appears to be ^ar too broad to lead to meaningf ul^^d useful 
principles or relationships In Information science*^ 

In our formulation we treat Information to bjf data of 
value in deaision^making. Later in the paper we define in- 
formation ^quantitatively and rigorously. While our formula- 
tion may somewhat delimit the total range of Interest In an 
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Intellectual sense* It docB have virtually universal applica- 
bility with regard to any potential applications for iuforma** 
tion. The authors also feel that any more general definition 
is not amenable to the quantification and conceptualization 
necessary to establish meaningful- relationships* An implica- 
tion of this definifiion then is tbat' inforiEkation is used onl^ 
for decision-making and that the decision maker has Only the 
resource of Mnformation available to hiTD,\ Thus* information 
and decision-ntaking are very closely bound^^ together in our 
general model . 

Levels of Information 

Research in the general area of information theory 
started in the mid-1940's» The basic theory, as already 
noted, was establishesd with the f undamental^work of Claude 
Shannon and Warren Weaver (4,S)^- This theory covers the 
transmission ^of messages over a channel, independent of mean- 
ing- Their defined measure of Information, which relates to 
the entropy of the interpretation of the sequence of bits 
transmitted, bears little relation to the layman's Concept of 
information. This is ^acknowledged by Weaver, who defines 
; three levels of information, the first of which (the techni- 
cal level) i^his concern. 

The second level of information is concerned with the 
meaning of inf(>r^ation - its semantic content. Significant 
research in this area has been performed by Carnap, Bar- 
Hillel, Winograd, and others* ^Thelr research has 

attempted to measure the semantic content of simple declara- 
tive sentences within their language system. In this con- 
text, they do not refer explicitly to the process of communi- 
cation between individuals. While the level information 
definition is concerned with the successful transmission of a 
^ message from point a to point fc, the level 2 definition of 
information is concerned with the successful interpretation 
or understanding of a message once it is received. 

The third level of information deals with the effective- 
ness of information i,e,> how information, once received 
and understood » is utilized. Hence the level 3 model is 
imbedded in a decision-making environment, since that is the 
only framework in which one can observe information utiliza- 
tion. Little research has thus far been accomplished In this 
area, even though it is probably rhe area of greatest signify- 
icance, interest, and application (8^9^10^11)*. Our research 
is in this area in an effort to develop a general and useful 
theory of information (1^2^3}* 
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i. 

There Is* of couise, a great body of literature In the 
decision-making field. Some of the typical references are by 
such researchers as Mortis (15) ^ Ralffa (16) ^ Sch^alffer 
(17)^ and Radnor (18), An excellent survey by Bandyopadhyay 
(19) provides further references to. research in thts ar^a* 
Unfortunately, we find that the approaches described In the 
literature are neither gen'eral enough nor sufficiently flexi- 
ble to represent the 'situation adeq^tely with regard to the 
use of information. In parti^ular^ there is little In the 
literature pert^ ,nlng to the non-exifert decision maker, 
whereas informatictn will be of perhaps greatest value In this 
situation* Furthermore, we Relieve it is necessary to con- 
sider the entire d«ifision process which is generally repeti- 
tive over periods of time* This process heavily involves 
feedback information using the r^^ults of previous decisions* 

The General Model 

Our general model of information flow and analysis is 
illustrated in Figure I, and we briefly describe its opera- 
tion. This model can be used to describe most, if not all* 
informations-dependent activities* It provides a way of look- 
ing at any information-decision interaction and defining the 
role and flow of infonration in the system,' The IAD module 
(Informatioiv' Acquisition and Dissemination) processes data 
for the system. Both exogenous (external environmental) and 
endogenous (internal feedback) data are acquired by the IAD 
module. Whenever a decision must be made, the DH module 
(using all of the data available) establishes the possible 
courses of action and selects/the *'best" one to execute, * The 
Execution module executes the DM-chosen course of ciction* 
according to all pertinent external environmental factors, 
leading to various outcomes depending on the alt^native 
executed- These outcpmes will be some observable quantities. 
They must be observable in physical sense if they are to 
have any effect. The Transformation module takes all observ^ 
ables of the alternative executed and turns the^e observa- 
tions into data- These data are fed back into the IAD module 
and we have come full circle, following^ the flow of informa- 
tion in the tttodel, ' / 

This model of a generali^^ed Information systbjn rests 
upon three basic hypotheses; ' \^ 

HI, Information !;; data of value in decision-making; 
H2* Jnformation gives rise to observable e/fects; --^ 
H3, Informfitlon fr^dhack exists so that the Decision 

Maker will adjust his model for later similar 

decisions* 
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Flgprc 1: The Genera lliied Information System Model 
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The first hypothesis requires that . Information be used In a 
declslon7iQaklng context* If Information is received, but 
never used or applied to a subsequent decision, then its 
effect does not exist and It cannot be i^easured. Hypothesis 
2 assures that If the decision-maker (DM) does raake a deci- 
sion, then the outcome of that decision can be observed and 
nteasur:ed< t This precludes decision-making In a vacuum* 
Ot>3ervables must^ exist' If the declslon-maktpg and the courses 
of action are to be evalOated, Hypothesis 3 indicates that 
the DM learns from feedback data resulting frpm previous 
declsloils^ Note that th<f observed outcomes of repetitive or 
related <(ecls-'on-maklng situations provide data upon which 
future decisions will Be made* 
\ 

Generallged Decision Maklnj^ 



This model Is dynamic In nature; eVen In a stationary 
decision sltu^tloi^ the DH^s mod^l may well change with time. 
A DM learns about his particular decision slt.uatlon and 
ejwlrotttnent as follows: - ^ 3 



1, 

3, 

5, 



He makes a decision (chooses a coAirse of action) on 

the basis of all information available to him; 

He predicts some probable outcomes^ 

He com}>ares actual resulting obseryables against his 

predicted obs^rvables (feedback learning); 

He updates his total n^dal of the situation as a 

result of this process; 

He returns to step K 



For any problem environment, a DM attempts to fulfill 
two main objectives: 

1* To choose the ''''best*' course oT action (c,o,aO 
according to some criterion given hls^state of 
knowledge; 

2< To learn the most about the total existing ^situation 
from the decislcn'^maklng process. 

It Is' Important to note that a D^jLJ^as these two main 
objectives In choosing a course of action, "Classical^* deci- 
sion theory says that a DM always chooses that c^o^a* that 
maximises some criteria* Thjs Is a considerable oversimpli- 
fication, and the DM In fact does not automatically choose 
the CO, a* with highest expected return. This is .true for 
least three reasons. First, because the DM tifay be\insure of 
his est;lmatG£^; second^ he may wish to learn more about thf > 
total situation executing alternatives other than the one 
with highest cxpqtted return; and third, the situation may be' 
changing with tinie, or if not the DM mu£;t generally asaure 
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himself that it Is b. static situation. 

Learning from any c*o.a, executed Is In Jact a very Im- 
portant objective of decision-making. The DM does this by 
monitoring the outcomes resulting from the decision. This . 
feedback updates the DM^s data base upon which decisions are 
based* Given the outcome of earlier decisions^ then fiow will 
the DM update his data base? If the outcome data matches the 
PM*s expectations, then his confidence will rise even though 
there may be no other change in his estimates. Hwfever, If 
the expected and actual results vary, then the DM wlllj Incor*- 
porate these new data Into his current estimates,. He learns 
from the deviation between his expected values of the out- 
comes and the actual values. Learning Is similar to sampling 
from a distribution and predicting the underlying theoretical 
distribution* The better Che DM's learning capability, the 
better his expected performance* The aiition of learning up- 
dates the DM*s stateof knowledge, with Input arriving as 
either external or feedback data as Illustrated In Figure I. 
Learning Increases 'the DM*s confidence In his perception of 
the decision situation. Learning more about a given sltua-^ 
tlon further removes uncertainty by giving the DM a better 
estimate of the varl us possibilities open to hlm\ 

^ D.fic Is Ion-Maker Uncertainties 

The uncertainties with which a^ DM must cope at any given 
time can be classified Into three categories; state of 
nature uncertainty, executlonal uncertainty, and goal uncer- 
tainty* The states of nature encompass the uncontrollable 
external conditions that will determine the various outcomes, 
tjependlng upon the decision to^6 made,* they might, ln<ilude 
for example weather, economy, ^competitive environment^ gov- 
ernmental regulation, \ The more l<;nowledgeable the DM Is of 
the probable current en^ronmental cofidltlons (1-e., the 
prevailing state of naturfe-Ju^-ttke more effectively he can make 
declslonf!* ^ 

Executlonal uncertainty appears In two ways* First the 
DM must Identify the co.a.'s avall;'.ble to him - his options. 
Second^ he must determine likely outcomes for^each c,o,a, 
under consideration. If any of five outcomes^ for example. 
Is possible fov a given co^a** then what If^ the probablllLy 
that a particular ono will occur? The DM must determine 
these probabilities of occjurrence of various outcomes for 
each c*o*a* This representf> his best approximation to the . 
actual situation* For any complex syftcem, the relationship 
between outcomes and cour^^ef^ of action is probabilistic and 
not deterministic ovi*u If the stat^ of nature w^re known with 
certainty, Inltjther word^, e>;ecutional uncertainry Is an 
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inherent part of the decision-making process. 

Lastly, goal uncertainty relates outcomes to goal^- 
achievement. The DM must examine each outcome considered and, 
evaluate it in light of his goals: i,e,, he niust (if he is 
to be successful) recognize the value or lack thereof of e:^ch 
possible outcome to the attainment of his particular goals, 

' - r 

Each of the uncertainties discussed has both a structure 
al arid relational context. The DM has structural uncertainty 
about the number of rej^evant states of nature, the number of 
viable alternatives, and the number of outcomes that may 
occur as a result of executing the alternatives. Any struc- 
tural deficiency will degrade ^he DM'fi performance; e,g,, 
not considering a certain c*o.a, or not knowing that a given 
outconi[^ may result will exascerbate the difference between 
the DM^3 expected and^^actual performance* 



Onc^ the structure is Identified by the DM, he must then 
vesolver- Relational uncertainties. What is the probability a 
given state of nature prevails?? what ts the piobability that 
a particular c*o,a* will result a specific outcome 
is the value of each o^come relative to goal attainment? 



What 



Some Examples 

Cet us now illustrate typical decision situations and 
specifically ivlentiiy the uncertainties facing the DM* 

Consider first the case of a family physician, the 
decision-maker. His decisions relate to proper diagnosis and 
treatment of the ailments of his patients. An ill patient 
visits his physician with a set of symptoms. The physici. n*s 
fir5t stop is to identify as best he can the illness giving 
rise to these symptom^. The illness is the prevailing state 
of nature. Inasmuch as many diseases may have overlapping 
symptoms and give rise to the set of those symptoms experi- 
enced by the patient, identiflcat-lon of the specific illness 
clearly is probabilistic. 

The ^ext step is to identify a treatment ^ the courst* of 
action* E^ch treatment viH have a number of effects, mos; 
of which /re kno\,'n to the physician only probabilisticall;* - 
even if he knew with certainty the precise illness (statu, of 
naturti).v For example, a particular medicine may have unex- 
pected side effects. Instead of curing the patient new 
symptoms may appear or old ones may be exascerbated, .. This is 
ex'ecut Joiial uncertainty. 



lERiC. 
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The symptoms are given a value structure by the doctor 
(and by the patient also). Some symptoms are obviously of 
little interest, and some are vital to patient health. Note 
that the symptoms are the only observables. When the symp- 
toms are measured, -they become data and perhaps .information. 
Blood pressure,* for example, is" a physical manifestation, 
whereas it becomes data when measured. Further examination 
of the patient provides information to the physician concern^* 
ing the actual effects of the treatment in comparison with 
the expected effects, and if thdse differ a new course of 
action may now be chosen and executed thus repeating the 
entire process. Tliis illustrates the feedback involved. 
Note that this iterative process i^^ the only way a physician 
as a DM can leafn more about the entire situation^ and in 
particular the effectiveness of various treatments. 

J 

A second example of some current interest which illus- 
trates our model and corresponding uncertainties involved is 
that of the economy rf the United States. The observables 
are the rate of inflation, unemployment, growth of the GNP, 
money supply, etc. The states of nature are inflation, 
recession, growth rate, energy availability, etc. These are 
dlearly all probabilistic in nature and of course, never 
known with certainty at any tiipe. In order to achieve some 
goal, which may be a specific growth rate or a reduced 
unemployment or a stable economy, certain courses of action 
are takrn by the Government, the DM, More money may be made 
available to consumers by lowering taxes,, a Government- 
financed job program may be undertaken, interest rates may be 
changed, etc. The relationships of these courses of action 
to the observables is probabilistic, and economists can speak 
only in terms of probabilities of certain actions having 
certain observablo outcom^^s. This is» of course, the execu- 
tional uncertainty which exists even if the state of nature 
were known with certainty. The goal structure is, of course, 
important and changeable. For example, does the President 
want to control Inflation or cut unemployment? Which is more 
important (has the higher value structure)? ^ ^ 

Tlie outcomes are measured periodically and the results 
(now dbta) are reported to the President who examines the 
observable outcomes in comparison with the predicted out- 
comes. Thifi is feedback. On the basis of his knowledge of 
the situation (his predicted model) and the data obtained, 
he readjusts hi? expectations nnd may choose a new course of 
action* and thus he reiterates the process. Again^ note that 
this iterative process is the only way to learn about the 
entire situation and the effectiveness of various courses of 
action. 
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Model Representation 

This decision-making process can be analytically model- 
ed In a number of different ways* One procedure that appears 
to represent this situation well and which can be , formally 
manipulated uses decision inatrlces as shown In Figure 2* 
These matrices are both of dimension.^ by n to correspond to 
the m alternatives and ti outcomes under consideration by the 
DM. An additional dimension should be added to each laatrlx 
''e*'it> m by tt by r) to express the I* possible states of 
nature. Extending the model to consider other states of 
nature Is straightforward and appears to add little to the 
discussion herein^ so for simplicity we consider only one 
state of nature In the remainder of this paper* We define 
the matrices (/ and V to be the decision state of the DM* The 
decision state relates to a particular decision^ Is unique to 
each DM, and will change with time* 

The W matrix describes the DM^s executlonal uncertainty* 
Element tJ. , represents the DM's estimate of the probability 

that execution of the i-th alternative will result In the 

0~th outcome* We denote by y the matrix describing the 
actual probabilities for the executlonal uncertainty of the 

decision situation. Each element u , . of matrix ^ repre- 

scnts the actual probability of occurrence of outcJme j If 
alternative i were to be executed* This is an apostet*iot*i 
probability In the standard sense and represents the fraction 
of times outcome O would occur If alternative i were executed 
many times* We repeat that these matrices as Indicated are 
for a single state of nature. There would In reality be a 
third dimension of dimensionality r for the different states 
of nature. 

The decision-ranker develops bis estimates of the tJ^/s 

on the basis of experience and whatever da^a or Information 
he bas available* These are his best estimates of tbe 

w ,/s. Tbe more "expert** the DM Is the closer his W,/s 

should be to the w . /s. 

^^3 

If Wjj ^ w , . V i,3\ then the DM has correctly assessed 
^3 1-3 Jt 
the consequence of his possible actions* It m < m y then the 

DM Is unaware of certain co^jrses of action; If < ?i , then 
one or more outcomes may occur of which the DM is unaware* 

It m ^ m ^ then the decision-maker believes that certain 
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Figure 2: f/ and V: The Decision state for 
' One State of Nature 
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courses of acclon are viable when in fact they are not^ Slm- 
llarly for n > n , We see that w,. ^ w for some sug- 

gests a relatioml uncertainty; n ^ n or m ^ m Indicates 
$tructia*al uncertainty. 

There Is a value for every possible alternatives-outcome 
pair. Therefore a value matrix also of size ^ by can 
be superimposed over ^the decision matrix Each element 
V,, of matrix V represents the DM's estimate of the value of 

outcome j as a result of executing alternative t, Hote that 
the value Is a function not only of the outcome but a]30 of 
the course of action chosen. The following examples 
illustrate why this must be so. 

Consider the situation where a document from a collec- 
tion Is chosen on some basis lo be relevant or non-relevant 
(the c,o,aO' 'if It Is chosen to be relevant and It turns 
out to be relevant (the outcome), then the set of {c,o,a,*, 
outcome) has a particular value to the DM. If, on the other 
hand, the docuip^nt were chosen to be non-relevant and It 
turns out to be relevant, then the value to the DM of this 
set Is quite different from the previous situation and Is In 
fact negative. 

Consld(?r the simple betting game of flipping a coin 
(heads or tails). The value tiiatrlx (If we win or lose a 
silver dollar) Is as follows: 



He;ids Tails 



Al ternat Ive { 



Heads 
Tails 



$1 



-$1 



{outcomes 

Value Matrix 



Clearly the outcome values depend upon the alternative 
selected. 



Consider al5;o a three ^jUernatiVe model where the op- 
tions are to buy, sc^ll, or hold a given stock. The outcomes 
are that the stork price ^oes up, down, or remains the same. 
Presume that the first outc^^me occurs: l,e., the stock price 
increases, Conriidc^rlng our throe alternatives, we observe 
the following: had the DM purchased some of this stock he 
would have realized a profit: had he sold some of this stock 
he would have realized a loss: had he done nothing he would 
have realized neither profit r.or loss. Hence we see three 
vblues for the same outcome; each is alternative-dependent. 
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Currently for simplicity we assurae V V y where V 
denotes the actual value matrix: i*e.f the DM correctly 
knows the value of each outcome Identified* Removing this 
assumption adds another dimension to DM learning* FulJ. 
generality, as we have Indicated, considers V to be of size 
m by rt by r for the r possible states of nature* It follows 
then that the value of an outcome depends also upon the 
existing state of nature, which may change with time* 

We have chosen to use an expected value DK)del for 
evaluation of the matrices*^ By this we mean that the 
expected value of any c*o<a< Is computed as the weighted 
average of the outcome-value pairs* Given the W and V 
matrices which describe the decision state of the DM, one can 
compute the DM*s expected value of each alternative &s 
follows ^ 

m 

EV. - r w,. v.. (1) 

Other procedures for determining values of c*o<a^'s can be 
used» but the expected value model Is reasonable and tracta- 
ble and thus convenient to use, ' 

The m EV^B computed represent the DM^s a33e38ment of the 
expected values of the m alternatives* The actual expected 

value of each alternative we denote ^y EV ^* This value Is 

4 . ' 

obtained by using elements W . . ot matrix ff for the DM's 

. 4 

W** values In equation (1) above. The EV . then represents* 

the average outcome value which would be expected If alter^- 
natlve i were executed m*iny times. The DM does not know the. 

4 

value of E^l'^ else he would simply clujose the alternative 
with the hlg[iest EV and thus? -maximize his Returns, The 

4 

closer the DM's EV vector Is to vector EV , the more correct 
his assessment of the situation and the better decision t&akex 
he should be* 



Our current model considers only positive EV values: 
Vi^ EV^ > £), We woulrf alscv like to treat negative expected 

values for the following reason: the DM must be penalized 
for choosing a bad alternative** Hence his outcome value for 
this alternative must be ncRative, as Indicated In the ^ 
relevant/non-rclcvant documfTit example described earlier. If 
enough executiops of alternative k will rcuult In a loss to 
the DM, then the resultant EV. will be negative. Negative 
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terms in our formulations cause certain mathematical problems 
which must be created. We plan, in the near future, to 
expand our model so that negative EV* s can be considered and 
handled hy the model. 

Ma king a Decision 

The DM makes a decision by selfeicting a course of action 

to execute. Just how should he make this decision? Clearly 

it will be based upon all the data he has stored rj^gardixig 

hi^ current assessment of the decision state: the f/ and ^ 

matrices* We have just shown how an expected value vector, 

EV^ can be derived from the decision state. If thfr DM Is to 

make a rational decision, then It must be based upon these 

data. Although. we do not. impose a specific decision strategy 

upon the DM> we will make one reasonable assumption. This Is 

that the DM will prefer alternative i to alternative ^ If . 

EV. > EV.. 
^ 3 

The DM must establish a probability for choosing each 
CO. a. In classic expected value decision theory> 'the DM 
will alikiys choose the c*o*a. with the greatest expected 
value* But selecting the alternative of highest EV is 
generally the best strategy only If the DM has\ virtually full 
confidence In his derived EV values. The DM may have consid- 
erable structural or relatlonaltuncertainty regarding the 
situation. Also, he may wish to learn more about the Cotal 
decision situation. The only yay he can do this is to sample' 
c.o.a.*s in addition to the one with maximum SV* Then he can 
^;omparc predicted and observed outcomes to learn and. re- 
evaluate his EV estimaces* rurthermore> the situation may be 
changing with time and the 1)M simply may not wish to rely 
completely upon his previously computed EV values. 

Thus we desire a method by which a probability can be 
associated with oach alternative* representing the DM*s 
pvobahility of selecting that alternative* This distribution 
should have the properties that: 

m 

a) I PfaJ = 3; 

b) EV. > EV. ^> P(aJ >'P(aJ; 

.f 

c) no DM confidence in his knowledge of 

7 

EV's => V. P(a.) = - ; that Is, with no 

t t in 

Information about the values to be expected, 
the DM will select: a c.o.a. at random; 
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d) total DM confidence In his knowledge of 
EV^s =^> P(aJ = 1 for TDaxlmum EV, and zerr/ 

for all otheVs* * 
We propose the selection rule 

c ^ r 

P(aJ = (EVJ / Z (EV.r 5 C Is a non-negative real (2) 

for situations Involving positive EV values. 

The variable C In equation (2) above Is called the 
confidence factor; the higher the value of the hlgher*^the 
DM^s confluence In his knowledge of the EK's. It C = 0 then 
PCa_*J = 1/m Vi and we have the tandom ca^* The has no ^ 

confidence In his current state of knowledge so he prefers to 
make a random choice rather than let his FK's determine which 
c,o*a. to execute. At the other extreme, C => ^ results in 
the classic decision theory rule: the alternative with 
highest EV is executed every time* 

The following lemma formally demonstrates that this 
selection rule dbes indeed satisfy the four essential 
criteria noted above* 

C ^ C 
Lemma 1 ; The selection rule p{a.} * (EV.) I (%V.) 

^ ^ k=l *^ 

for EV, > 0 satisfies the four requisite properties for 

establishing the DM selection distribution. 

Proof ; 
m 

a) I P(aJ = J, 
Ul ^ 

l/et P(a J be defined as in equation (2), 

' m m p - m ri 

Theti I P{aJ'= Z \{EV.r / Z (EV,r\. 
\i=2 * i=2 ^ k=l J 

m m m 

Hence I F(a.) = I (rVJ / I (EV,r ^ 1. 
i=l ^ i=l ^ h=l 
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>) EV^ > EV. => P(a^) > P(a^j, 

Let EV. > EV . . 
^ 3 

Then (EV .)^ > (EV ,f ^ C ^ 0, 
^ 3 

/ 
\ 



- Hence CFP'J / I (EV,r>(EV.r/ I (EV,)^: 

t.e., P{a.} > P(a J. 
t .1 



3 

) No DM confidence in his knowledge of 
EV's => V. P{a.) ^ ^ , 



Let C = 0, V; 

^ m 

Then we have V. P(a.) = (EV.) / I (EV f 

m - 

Hence V. PCa J = j / i; j = i. 

Total DM confidence in his knowledge of 

Erz => 3 i ) PiaJ = 7 and all other P{aj^) = 0, 

Assume 3 i ^ Vj^ EV^ > BVj^ for i ^ k. 

Then consider the term P{aJ as C <». 

C •> no p(a.) = C « 
t 



lim r 



= C CO {2/ 



lim 

= C ■* a> 



m 



I {EV.f/ (EV,)^ 



(i/ {(Ev// (Ev/]} . 



since EV. > EV, . 
t k 



20 



18 



Ustly. for ;t = t }^J(EV,)^/ m 




Declslon-Haker Learning 



In our approach, we use equatifSns (I) and (2) In order 
to calculate Expected Values and Probabilities of alterna- 
tives available to the DM* /The following sequence of events 
then occurs. This procedure Is a general one for all 
expected value models and Is not dependent upon specific 
formulations of the probabilities. In actual practice, the 
DM may determine probabilities mainly by judgment rather 
than from calculation. 

I* DM estimates or predicts EV , for i - 1^ 2^ m on the 

basis of all of his past experiences using equation (1); 

2* DM establishes P(<2*} for i ^ Ij 2j m from his 

estimates of the EV. and his current level of confidence 

in the data. In our approach. he uses equation (2) to 
derive these estimates; 

3* DM now executes an alternative, ky in accordance with his 
estimates of the probabilities developed in Step 2; 

4* Given the prevailing state of nature, some outcome occurs 
as a result of executing alternative k. Remember that 
the DM is only pr- bablllstlcally knowledgeable about 
which outcome wll' 'jccur* 

5* The resultant ouL.ome is now fed back to the DM in 

accordance with Fi .ure 1, permitting the DM to upgrade 
his assessment of Lhe situation* 

6* On the basis of this feedback information the DM updates 
his estimate of EVj^ and his assessment of ths probablll" 

ties of the outcomes for that alternative* Note that the 
DM^s assessment of th^ decision situation and all th^ 
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values thereof are a function ot his previous experience 
and the data obtained from ihe decisions he has made. 

7* Go back to step 2> update the P's using the new ffV^, and . 
continue* 

Step 6 In the above characterization of DM activity^ \ 
using feedback data to update the DM*s state of knowledge 
(or decision state). Is what we call "relational learning*'. 
This learning can be considered 'to be effected by making row 
changes to the matrix* Or> la-fli ^or^ macroscopic sense, \we 
simply alter the current EV assessment corresponding to the 
alternative executed* In either case (macro or micro) the j 
end result Is an updated DM estimate of EVj^^ No other EV's I 
are altered since only one c*o.a* has been executed; ^the 
feedback data clearly relates only to the alternative 
executed* Of course from equation (2) we note that all his 
probabilities are altered due to a change In one EV and/or a 
change In his confidence. 

Learning can be moSeled by ad^jstlng the DM's expected 
value of the alternative just executed. The value of the 
observed outcome Is averaged Into the DM's EV approximation 
In some way* A number of learning rules could be used to 
update the EV's. We have, for convenience, chosen the 
following learning rule Inasmuch as It does seem to be 
descriptive of the actual process* In this situation c*o.a. 
k has been executed at time t resulting In the actual value ^ 
Vj^ft) occurring* Th(i DM then updates his old estimate of the 

expected value for c*o*a* k by ' ^ 

That Is, the expected value of alternative k at time t-fl is 
simply a weighted average of the expected yalue at time t and 
the actual outcome value ol>talned at time t, V^(t), 

The learning parameter > should be a decreasing functloi: 
of time and confidence* For Instance, a possible definition 
of \^(t) might b(i: 

\^(t) =^ lAKCy^l) X numhcv of trials for c'.o.a* kl* (4) 

Variable Cj^ is the DM*s confltl(ince factor In his estimation 
of EVj^ and goes from 0 to infinity* 
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Note that when the DM has little confidence In his 
estimates^ or when he has little data on vhlch to base an 
estimate^ his learning vlll be large (almost one) and vhen 
his confidence Is^hlgh the learning 'will be small (almost 
zero) * 

Two Important aspects of this learning algorithm should 
be noted* Tlrst^f^lt should be clear that learning Causes a 
chaltt-reacclon: altering a row of the'j/ matrix alteifs the 
res^ctlve EV which In turn alters th6 DM*s probabilities for 
selecting an alternative (by our selection rule). 

■ SecQsjgdj the DM*s confidence plays an Important role^ In v 
both learning and'selectlon* ALchough Che parameter^ .confl-* 
dence^ Is used In both equation (2} for selection procedure 
and equation (4) for learnings the two may differ Inasmuch as 
they descrlT^e different phenomena* Furthermore^ In equation 
(2) the^varlable C is* an overall confidence In the entire 
situation, whereas In equation (A) the var^ble Cj^ applies to 

the confidence that a^.DM in his. knowledge of the outcome 
of a particular c,o,a* Further research on this matter^ both 
conceptual and experimental^ Is , underway * ' ^ 

The Basic Information Measure 

Given our model of Information flow and analysls4 we can 
now develop definitions of Important terms whlifi can then be 
quantified and measured and which are of course consistent 
with the basic theory. We first define our fundamental 
measure of InformatloTfc from the standpoint of e-f fectiv^^ne^^s, 
All levels of Information have one Important point In common: 
Information reduces some uncertainty* Uncertainty In the 
effectiveness sense sifould relate to the DM*s, choice of a 
c,o*a. How certain Is'^the Dtl about which alternative should 
be chosen? 

The uncertainty In choosing a course otySct±on clearly 
relates directly to the DM^s probabilities of executing each 
course of actloiT; For example, If all of the proMbllltles 
are the samet th*»n the DM is totally uncertain which alterna^ 
tive should be selected* At the Qther extreme^ If the DM Is 
completely certain as^o his course of action then for some 
P(aJ = 2 and all 9! the other probabilities are zero. 

Thus we choose the vaptance of the P*s as a basis for our 
measure of Information, Note that the variance Is zero when 
all of the P's are the same and a maximum when one P Is unity 
and the others are zero* 
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2 

The meaA square variance of the probabilities, o fPJ, Is 



by definition; 



0^(P) ^ I tPfaJ - )x(V)f/m, (5) 



and'the me^n^ WCPJ* Is 



t P(a.) 



\ 

i /m ^ > ^ (6) 



whsre m Is the number of viable courses of action* 

\ ' * 

\ ' ^ ^ \ 

yVny b\slc measure of information 'shouloypossess a number 

of fimdamental prdpertles, ^Flrst, It should\e defined in 

terms of some fundaojental unit of me^^^e* It\should be at a 

maximum ^hen the variance of the element Is maximal, and It 

should be at a minimum when the variance Is minimal* These 

bounds should be well' defined. The measure" stpuld be 

Indifferent to the order of consideration of the elements* 

i\ must be stable; l,e*, the consi^deratlon of an additional 

c/(i*a. of low probability should ^ot have a significant 

effect upon the measure* Finally^ the measi^re should be , 

se<(Tjentially additive. Whether applied once to the entire 

set ot elements or respectively to a set of mutua^^ 

exclusive and exhaustive subsets^^i:he measure should yield 

^the same result, A measureO>f Information which possesses 

the aforementioned propert^^ would provide a sound basis tof 

our theory of effective iftformation. 

We h|ivc lndlcaO<^3 that any effectiveness measure of 
inforj^iati^n must rcUatc to the variance of the DM'? probabil- 
ities of selection of the alternatives. However, It Is not 
the >)arlance directly but the normalized variance which Is 
Important, The simplest way to consider the variance of a 
populntion In a normalized form i^; to divide it by the 
square of the mean, th<it Is to consider the r,m.s. deviation 
In terms of units of the mean. It is clear ^hat we must 
^nslder a normalized variance since a given variance about 
the r.ieau will be much less significant when the mean is large 
than when the mean is small. 

Hence we define our fundamental meagure of information 
td be: \ 



I ^ o^(P)//(P)- (7) 



Since ]j (P) = l/in (see equation (6)), we observe that this 
measure relates the vntian* to the number of courseti of 
action. ' ^ 
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Referring to equations (5).* (6). and (7). we see that 



m / 

2 {P(aJ 




2 



This quantity possesses the desired properties for an Infor- 
mation measure as we now demonstrate. Thus, we define this 
quantity to be the amount of infomation in the decision 
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■ '^"'^j ^(a/ -1 . (8) 
Proge^ tles of . Information M^asurP 

The Information mea-are as defined possesses most of thp 
fffe"JvS"'^^'°' ^ fundamental measL of InfoXl^'^ 

This quantity has a minimum of zero when 'all the P^aJ's 
are equal to - (pure chance). This is complete uncertainly. 
The quantity has a maximum of m - J m the case of complete 
certainty where one of the ViaJ^s is one and the others are 

ou.nt5Trr'*'ni possible courses of action, the 

quantity J will assume values frgm zero to one. It will be 

Probabnitr °' certainty, i.e.. when the 

probability of choosing, one course of acMon is one «nH 
other probability 1. zero. , Accord Ingi r^irwllVd f n" t, 

sU^atloi a^determmistlc two-chol« 

situation. Thlf unit we call a bimry choice. unit, or b.c.u. 

l^hen there are ^ possible courses of action, then the 
^xlmum amount of Information from equation (8) is's::nt be 
.r^nsJt I ^ \ agreement with a) well-known 

ho c':f f^o^ VlT'']' f'^' ^ deterministic 
Choices from pairs .yf nlternatlves Is required when there 

cltLV ""-i'^-r- More explicitly, if 7 

choices ore require,) and the ^.xlmum amount of Information In 
each choice s one. then the ..nximum amount of Informa Ion is 
' Analogously the minimum a^iount of Information Is 



m - J. 
zero. 

\ 
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Clearly Che measure is indifferent Co the order in which 
the elements are considered* S^ince addition is associa- 
Clve^ Che P's can be suinmed in 'any order yielding a unique 
reaulC Hence Che alCernaCives can be considered ^in any 
order* 

The consideraCion of addiCJLonal courses of aQCion of lov 
probabiliCy have an insignif icanC effecC upon the measure* 

2 

This is seen from equacion (8) inasmuch as the sum of Che P 
will be essenCially unchanged vich che addicion of such a 
CO. a. However^ Che m will change by one and thus Che rela- 

2 

Cive inforciaCion change is proportional Co ^ * Thus Che 

addicion of a new c,o*a* does noc significantly alcer I for 
reasonable size 

An addicional quescion to be considered is the addlti- 
vicy of our measure. The measure iCself clearly does not 
possess simple linear addicivicy since ic is based on a non- 
linear discribucion, ecg,, the variance. This musc be Che 
case inasmuch as Che probabUiCy of choosing any course of 
acCion muse depend on all Che oCher courses of acCion* How- 
ever> che measure docs have an ipporCanC addiCiviCy properCy 
Involving cxpecCed values. 

The probabiUcy of choosing any course of acCion is a 
funcCion of Che decision-maker's expccLaCion of all Che 
valrtes as we have seen in equation (2)* The values (or che 
expectation of che values) on che other hand are independ^nC 
of each oCher. VJe show below chaC Che values of subsecs of 
the courses of action arc indeed additive and can be consid- 
ered separately. Thus in gaing from che values Co che 
^robabllitieift Co informat ion wo show an imporCanC addiCiviCy 
property. Hence the deci*;ion^maker's estimate of performance 
(defined in equation (12) belo\j) for disjoint subsets A> B of 
the courses of action has Che following addiCiviCy properCy; 

The DM's estimate of performance with seCs (A, B) equals 
his cstinate of ptrformance for seC (A) multiplied by che 
probabiliCy of seJe^^ting seC (A) plus his esCimaCe of 
pcrforriancc; for sqt (B) nulCipHed by the probability of 
sv*leccing .sec (K), Thus in order Co add informaCion in dis- 
joint seCs we musC first c>)nsidor the fundamental values. 

The proof of this sCaCemenC follows: 




Consider set S of alternatives a^, a^, a and Its 

associated EV^ and F^(aJ for i ^ 1, 2, then by 

definition from equation (12) below 



Now consider a partitioning of S into disjoint subsets A and 
B whose union is 5. As order of evaluation for DP^ la 
unimportant, rename f:he alternatives so that 

k 

consider computing DP^: ^ote that I P .'a J 4 U since 

k < m. If only these alternatives are to be considered then 
they must be factored unlfonnly so that they sum to 1. Hence 

k 

we set P/a,} = P^(aJ/ Z P^(aj}, which uniformly ir^reases 

k 

the probabilities for alternatives in A 5 Z p (a ) - i 



Thus DP = Z P (aJ EV. ^ Z 



k 

P^(a^} BV. / Z P^(a.) 



A similar term Is derived for set B; l,e,, 



m 



m 



^^R = ^ PJaJ EV. = Z 



If a DM now wishes to combine these two evaluations to con- 
sider a]] m alternatives col] ect Ive] y. then It Is only 
natural to consider the sets A and B as two alternative sets 
with associated probabilities of selection p(A} and pfD) and 
estimated values DP^ and DP^. Thus. 

^'^/lUS " ^^^^ ^ ^^A * ^^^^ ^ ^'^B' 



k 



P(A} = Z P^(a,} ano p(b) = Z P (aJ . So substituting 
PiA), P(B), DP^ ant! DP^ into our equality, we have 
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DP 



4ue 



I PJaJ 



m 



I PJaJ EV. / I PJaJ 
i=f3 3=2 ^ 



I PJaJ 



m 



m 



m 



= Z PJaJ IV. = £)P^ . 
1=1 



Amount of Information In a Data Set 



A measure of the amount of information in a data set or 
message can be arrived at by computing the difference in the 
amount of .information in th$ decision state after and before 
receipt of the data. That is> the amount of information is 
determined by considering the impact these new data have on 
the decisioi -maker's decision state* In symbolic terms> 
I(D}, the amount of information in data set is 



KB) ^ I 



t-hl 



(9) 



where ^^^^ ^t amounts of information in the 

decision state after and before receipt of the data set, 



It should be noted that the amount of information in a 
dnca set mqy be either positive or negative* In general^ 
positive inforii^ation sharpens or refines ^he decision-maker's 
understanding of the situation in that it either reduces the 
number of structural components in the model or reduces the 
dispirsion in one or more of the various probability distri- 
butions in the motleK Negative information, on the other 
hand, either increases the number of structural Qom^onents 
(e*g*, tb^ addition to the modol of av previously unknown 
alternative or outcome) or increases dispersion in the 
various distributions* Negative information, despite a 
possible connotation of the term> does represent information 
that is of significance to the decision-maker. 

This measure will in gen*?ral vary with time; it will in 
genf>ral jdlf fer with different DM*s and with different 
situatidns. This variation is consistent with the fact that 
data cannot be evaliiated out of ''ontext. For instance, a 
given doc^ument which is relevant to a scientist working on a 
problem ib nuclear physics is probably non^relevant to an 
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econjmlst. Knowing next month's projected output is of value 
to a DM worried about finding buyers or projecting future 
output, but after that month has passed the DM will uae the 
actual output data, not the old projections. Lastly, each 
DM l8 different and thua may react differently to the same 
data; hence a different KD)* This Is a meaaure peraonal to 
the DM that Is time and situation dependent. 

Related Measures 

We have now defined a quantitative measure of the 
cunoxmt of Information In terms of the fundamental unit, 
i>.cu. From an effectiveness standpoint, we are further 
concerned with the value of the Information. In order to 
establish a measure of the value of Information, we flrat 
must define a term which describes the capability of a 
decision maker to Achieve his goals. Such a term we will 
call declslen-maker effectiveness or DhfE^ We can then define 
the value of Information In terms of the corre^ipondlng change 
In the DME. This vlll then be a measure of the effectiveness 
with which the DM usea the Information available to him. 

We will define DME In terms of the average expected 
performance of the DM at any given time. The DM executes the 
c.o.a.'s In accordance with his probability rilstrlbutloi 

The average outcome of alternative i Is EV . , the actual 

expected value. Thus, average DM performance, v4P, can be 
expressed as: 

^ n 

AV = I p(aJ EV. . (10) 

If the DM makes a series of decisions with theSe probablll'- 
tlos, than his performance, on the average ^ will be that 
projected by AP, Actual DM performance at tlms t Is a 
spcfclfic value ^f^(t^ which is obtained from the alternative 

executed, aj^* Uote that Vj^ft) will In fact be one of ^jy's 

associated with alternative k as seen from observation of 
Figure 2. The valuos obtained by executlon'of c.o.a., a^^ 

will vary according to the probabilities defined by the 

starred matrix and will vary about the mean EV^ with a 

variance determined by the valuer knd their probabilities^ 
Observation of each row of the value matrix Indlcatefif the 
extreme values. 



2'J 



Because of the fluctuations possible In actual DM 
perforlhance, we define the decision-maker effectiveness In 
terms of the average DM performance a& compared to the maxl-* 
mum possible DM performance* The maximum possible DM 
performance occurs when max ^V.* i6 chosen with certainty* 
Xhus 

im ^ AP/max(SV.^)j 

Dm ^ t P(aJ (EV. )/max(EV. ). (11) 
i^l ^- ^ « 

DME Is a dlmenslonless unit which goes from zero to one and 
tells us how well the DM Is able to meet his goals* Hote 
that AP Is clearly additive in the same way as we showed 
above for DP^ the DM*s estimate of his performance* 

A rational DM should Increase his DME with time on the 
average, as ^^iCLX (EV^ ) Is constant and average performance 
(ZP(a J EVj ) should Increase as feedback data enhances the 

DM's probabilities of choice, PfaJ* We see that if 
P(ci^i ^ for the maximum valued EV^ , then DM ^ i, the 
maximum* 

Of course* the DM does not know the EV *s with 
certainty. He can only approximate them probabilistically* 
Therefore, the DK can only estimate his Z3HE*iand, In fact, 
his best approximation to his performance Is given by the 
term we define to be the DM expected performance, DP, That 
Is 



DP ^ Z P(aJ EV, J (12) 
i ^ ^ 

where EV . Is the DM*s cstlmati^ of EV . . As the DM becomes 
t t 

more expert, his f>P appronch*^s AP, 

The DM does not knov the tnax EV and therefore he can 
only estimate his DlfE from equation (12). This would take 
the form of DP divided by his estimate of the maximum 

Every decision maker has a perception of his own effective- 
ness for a given situation. We are Interested empirically 
in relating the OM^s estimate of his effectiveness to that 
calculated from our equations abov^ for DME and DP, We are 
planning both simulations aim tixperiments to determine the 
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similarity of these two terms* 



Value of Information 

Decision-maker effectiveness, as defined in eqiiation 
(11), provides the basis for our measure of the value of 
information^ Q(D). As our measures are concerned with the 
effectiveness level of information, it is natural to define 
the value of information to be related to its effect up6n the 
performance of the DM* Did the new data increase or decrease 
the DM*s performance, and by how much? 

t 

Because of the variations possible in actual DM per*^ 
formance at a given time^ we believe it is only meaningful to 
consider the performance on an average basis* This^ of 

2 

course, is accompanied with a mean square deviation, o about 
the average. Hence DME^^^ * ^^^^ would show the change in 

DM effectiveness (see equation It) due to information 
received. Thus we define QfD}^ the value of the i^QTmxtion 
in data cet as: } 

Q(D) ^ - Dm^ . ^ (13) 



The measure DME is well defined and ranges from 0 to I; hence 
our value measure Qiph ranges from -1 to +1* Data that 
results in decreased DM performance are of negative informa-- 
tion value; if they do not effect perfornuince, then they ate 
of no value, and Q(D) ^ 0. 

The value meafiure Q(P) is described in terms of a basic 
unit: DME, It has prescribed upper and lower bounds that 
are consistant with the intended meaning of Q(D) The 
measure is associative and additive if the AP is considered 
directly* Thus^ this measure, Q(D) y possesses all of the 
properties wa require of a fundamental information measure* 

Ucnce we have developed two fundamental metrics which 
measure infOiTntion amount^ 1(D), and information value, 
Q(D). While the quantity X(D) shows the change in the DM*s 
plans for dealing \:ith th^ situation, the quantity Q(D) 
defines the value accrued from the DM's change in probabili- 
ties. These two measures are thus distinct, yet they are 
interdependent, llowever, the relationship between them is 
quite complex. Information amount deals with the DM*s 
actions; infoi'matiota value relates to DM performance. 
Further research will determine under what assumptions 
general relatJonsthips can be guaranteed. 
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SuMnary of tie flnltlons 

In this paper we have developed a number of Important 
definitions characterizing information and decision-making* 
This section reviews those definitions so that they can be 
considered together in a meaningful manner* We list each 
term, describe its meaning> and repeat its definition ap 
given previously. 

a) Expected Value of a c*o.a., a^: the expected yalue of an 

alternative is the weighted average of ^the outcome 
values* * 



m 

b) Selection Rule for c.o.a,'s: the probability o£ 

selecting alternative i is proportional to its 
relative expected value raised to the DM's 
confidence. 



(1) 



p(aj « (Ev.r/ z {Ev,r . 

c) Learning Rule for expected value of c.o.a. (<i^^' the 



(2) 



new expected value of alternative fc, given the 
outcome value of a prior execution. Is a welghte'i 
combination of the old expected value and the 
observed outcome value. 



d) Information In the Decision State ; the amount of 

Information in the decision state of the DM In 
b.c.u, *a is 



(3) 



J = m i: pfa.y 



(8) 



e) Infortnntion A noint: the tiinotint 6f information in a data 
set D is defined as the change in the information 
of the DM^s decision state after and before 
receipt of the data* 



KD) ^ J. 



(9) 
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f) DM Actual Performance : actual DM performance at time 

Is the actual value of outcome which Is obtainad 
from the alternative executed, a^^; 



DM 



actual performnoe (t) - ^^^^^ ^ * 



g) DM Average Performance : the average performance of a DM 

Is the weighted average of the actual expected 
outcome values* 

j1? = r Via J EV. . (10) 

h) Declslon^-maker Effectiveness : the effectiveness of a DM 

Is thc^ratlo of his average performance to the 
^taxlmym expected outcome value* 

^ h h 

DME ^ Z ' F(aJ (EV. }/max(EV. ) • (11) 

1) DM^^Expected Performance ; the dH^ estimate of his 

average performance Is the weighted average of his 
expected outcome values* 

m 

DP = t P(aJ EV. * (12) 

i=i ^ ^ 

j) Information Value ; the value of the Information In a 
data set £) to a given DM Is defined to be his 
change In effectiveness* 

Q(D} ^ - OME^ , (13) 

Conclusions and Further Research 

The fundamental goal of th^s research Is to develop a 
comprehensive, usable theory of Information at the effective- 
ness level* Thus far we have defined a detailed model for 
Information flow and analysis. We have suggested th^at most 
decision-making situations can be modeled within this formu-^ 
latlon* We have developed an underlying mathematical frame* 
work to dc^ne the decision stata of the decision maker; 
matrices OTid-J<* From this framework we have algorithmic 
cally defln^ procedures to model, we believe realistically, 
DM data assimilation, DM selection, and DM execution of 
alternatives* The entlra model Implies Iteration many times 
so that the DM cdn better estimate the decision state and 
various associated parameters- With this framework we 
believe that we can accurately describe the use of 
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information in an effectiveness sense and the role of 
information in the total decision proceaa. 

We have defined herein a number of itsportant information- 
^related measures. Two of these of particular importance are 
the amount of information XfD) ^nd value of information Q(D} * 
tfhich quantify the information in a data set D*' Other 
measures that can be derived from our model include the 
amount of information in the decision state (D* decisions- 
maker effectiveness (VME) y decision-maker expected perfor- 
mance (VP) and CM average performance (AP) * These measures 
provide us vith ^ quantitative bssis for analyzing and 
defining information flov and for identifying limitations of 
this flov* 



Continuing research involves establishing relationships 
among these quantities and the significance of eafih to the 
.information flow process* We are seeking generalized infor- 
mation relationships in an effort to establish fundamental 
guidelines for information flotf» analysis* storage*^ and 
processing* In addition* ve feel that generalized rules for 
making decisions under various conditions - a decision 
calculus will emerge from th^s model as well* 

We are planning^to apply this theoretical development t' 
practical situations and indicate how the quantities can be 
defined} measured* and used in a practical way. In particu-* 
lar» we are developing examples using a .bibliographical 
retrieval system, a production control situation, and a 
general economic model* 



validation in an empirical sense of our theory and measures. 
We have developed a simulation model to verify some of our 
basic measures and procedures and to determine their value* 
Two versions of the simulation mod^l have been itttplemented 
in PORTRAIT: a batch model and an interactive model. The 
batch model is running on an IBM 370/168 and is being used 
for running long repetitive decision situations with many 
trials. Aggregate data from test cases are being studied to 
determine if the results are consistent with the, theory and 
to fitfd further relationships between the basic quantities 
defined in out information flow model* The interactive model 
is running on d PDP-IO and enables direct input to be msde 
by a human decision maker. We plan to conduct actual experi- 
ments using a document collection and real decision makers^ 
in order to S^tablish the various paramaters and their 
validity. 
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